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DEFINITION OF TERMS 



PAG - Parent Advisory Committee 

BMS - Behavioral Maturity Scale 

RCT - Reading Criterion Test 

EES - Educational Evaluative Services 

President: William White 

R & D - Research and Development Division 

Assistant Superintendent; Jarvis Barnes 

RA - Research Assistant assigned to Follow Through 
RA: Willard Crouthamel 

MAT - Metropolitan Achievement Tests 

CIP - Comprehensive Instructional Program 

(an Atlanta based program) 

ISC - Instructional Services Center 

Assistant Superintendent; Curtis Henson 

FT - . Follow Through 

Director; Francis Cox 

FY - Fiscal Year 

DAD - Direct Approach to Decoding 

MRT - Metropolitan Readiness Test 

ITPA - Illinois Test of Psycholingustic Abilities 

SRI - Stanford Research Institute 

ILM - Interdependent Learning Model 

EGA - Economic Opportuni.ty Atlanta 




INTRODUCTION 



The purpose of this final report is to provide information and data to 
school decision-makers. The traditional format for writing research reports 
is replaced by a style which seems to be more communicable for the Follow 
Through Program. Traditional designs such as the pretest-posttest were 
utilized only if they provided the decision-maker with useful information for 
improving the school program. Much of the detailed information found in more 
traditional evaluations were referenced in the text and included in the 
appendices. The appendices provide a basic storehouse of knowledge which may be 
referred to by individuals not completely familiar with the program. 

What Type of Decision-Making Information Is Included in This Report? 

The thrust of the report is the identification of promising practices, 
major contributions of personnel, and weaknesses of the program. The report 
relies heavily on the teachers' feelings about Follow Through and on project 
deviations (that is, were the objectives actually being pursued?) - 

The extensive data collection effort made by Educational Evaluative 
Services (a subcontracted service) made it possible to begin answering some 
rather critical questions. Much of the information presented is, therefore, 
in a question-answer format and is based on both hard and soft data. Arguments 
are advanced as suggestions for improving the program and are solely the 
opinion of the research assistant. 

Who Were the Decision-Makers? 

There were many members of the educational community,; not just Follow 
Through personnel, vdio made decisions relating to the program. The individuals 
vdio were most directly involved and the kind of information they need are 
listed on the following page. 
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1. Top school system administrators (Dr. John W. Letson, Superinten- 
dent; Dr. E. Curtis Henson, Assistant Superintendent Instruction, 
Dr. Jarvis Barnes, Assistant Superintendent) and area superinten- 
dents (Mr. E.A. Thompson, Area V; Mr. J.Y. Moreland, Area I; 

Dr. H. Mark Huie , Area III). 

Need: Information to help clarify the broad instruction^ 

picture the kind that may be useful for system- 

wide planning (that is, the impact or spin-off' of 
successful practices which might be effective in 
' " other schools). Cost-effectiveness and management 

and control data would be useful. 

2. Fdllow Through principads and head lead teachers (Mr. Fred D. 
Hammonds, Assistant Principal; Mr. Calvin C. Williamson, Principal; 
Mr. Robert G. Warren, Administrative Assistant; Mrs. Mary F. 

'Gilmer, Principal; Mri James P. Taylor, Jr., Principal; Mr. Andrew 
J. Le\ds II, Principal; Mrs. Daisy C. Harris, Lead Teacher). 

Need: Information focusing on the school staff being more • 

goal and objective oriented and systematic feedback 
for making staff and curriculum decisions . > 

3* Follow Through teachers and aides. 

■ ■ ■ Need: Diagnostic data to assess the characteristics and 

progress of individual, children in terms of 'observa- 
ble traits and skills. 

4 . Parents and community representatives (Parent Advisory Committee, 
Community Action Agency, and others). 

Need: Data on the kinds of pra^ctices which seem to be 

. , effective with their children and if these practices 

are being effectively implemented (accountability). 

5 . Follow Through Central and Model Staffs. < 

Need: Information on the effectiveness of the various 

components of the program, the degree of institutional 
change, lines of communication, and the implementation of ’ 
the process . 

. . ' . ■ . ‘ ' ■ • ' • 

It should .also be noted that Follow Through consultants , and national 

representatives have certain decision-making domains and that they should 
have access to all of the data. 





Was an Evaluation Model Developed Which Helped Integrate . 
the Various Instructional Support Systems? 

A systems approach was used by Atlanta Follow Through to encourage an 
accurate and timely exchange of information. The rationale for the system 
was three-pronged: 

1. Evaluation Was Entirely Tied to Instruction. 

Research personnel constantly were interacting with staff members. 

2. Evaluation Was Conceived of as Information for Decision-Makers. 

The collection and analysis of data must be of value to a 
de ci s i on-maker . 

3 . Information Flow Was Directed Toward All Personnel. 

i 

The big picture was spelled out for each staff member so that he 
was familiar with all aspects of the program. 

To implement this rationale the following actions were taken: 

1. Goals and objectives (and needs) were continuously clarified by the 
staff. 

2. A computer-based retrieval and feedback system was established with: 

• Student profiles available to teachers. 

• Quarterly feedback forums scheduled for the staff. 

• Quarterly written reports with data interpretation. 

• A data bank that included multivariate information (see Appendix 

page A-1 ) . 

3» Relevant variables and measures of growth were continuously determined 
based on: 

• Longitudinal Measures. 

• Standardized Tests . 

• Criterion-referenced checklists. 



4* Program monitoring and evaluation (an independent audit) was 
performed by the research assistant by focusing on: 

• Management-Control, Process, Diagnostic Procedures, 
Communication, and Cost-Effectiveness. 

• Classroom observation. 

• Evaluation Design (gains, comparisons, and the like). 

f 

5. Dissemination and reporting were accomplished by means of: 

t 

I 

I * Student profiles and printouts. 

• Feedback reports. 

• Progress and final evaluation reports. 

Did This Evaluation System Work Well? 

This system worked extremely well vdien consultants and administrators 
helped teachers specify what data outcomes lead to vhat teacher actions. 
Illustrations of the relationship between outcomes and actions \diich were 
specified this year included: 



OUTCOME 

1. BMS correlations (teacher vs. aide). 



2. RCT, CIP levels 



3. Self-concept scores 



ACTION 

Teacher and aide talk 
about differences if 
correlation is below .70. 

Teachers work with child 
at diagnostic level he 
is at. 

Psychologists work with 
children who scored lowest 



4. Color-shape scores 



5* MAT item analysis 



Quick-easy test to see 
which children need 
immediate help at the 
beginning of the year. 

Curriculum developers 
and teachers can identify 
the types of skills that 
new model techniques 
might focus on. 



6. MAT, Self-concept means Evaluators should make 

statements of the 
effectiveness of the 
program on achievement 
and self-concept. 

It would seem that data shouD.d not be disseminated to teachers or staff 
members unless they loiow what action is to be taken based on the data. For 
example, no one knew \diat action to take based on BMS means and standard 
deviations. (The BMS was eliminated as a post measure because of this.), 
probably the basic reason the Illinois Test of Psycholinguistic Abiliti^, 
the Self-Social Constructs Test , and the Torrence Test of Creatxv^ Thinkxn^ 
were not administered this year was the lack of action from last year’s 
results. If a measure such as the "I FEEL ... ME FEEL” Self-Concept 
Appraisal or Reading Criterion Test is administered to assess each individual, 
the teacher must have a clear idea of what action she is to take based on each 

child’s score. 

Tests might be classified according to the decision-makers for which they 
are primarily intended. If, for example, the self-concept scores are beneficial 
information for decision-makers, but not as part of an individual student 
profile, then it is sufficient to test a sample of students. 

Inform? tion flow must not be a convenient label for a mass of xll- , 

defined activities and phenomena. Ellis Richardson’s diagnostic plan for , 
individual assessment and related, action is an illustration of a very positive 

action-approach toward reading improvement. 



RECOMMENDATION; IT IS HIGHLY RECOMMENDED THAT THE NEW ASSISTANT 
DIRECTOR ALONG WITH RESEARCH PERSONNEL (EES, R & D) COMPILE A LIST 
OF THE TYPES OF DATA (BMS SCORES, BMS MEANS, BMS STANDARD DEVIATIONS, 
BMS CORRELATIONS, COLOR SHAPE SCORES, MEANS, AND THE LIKE) THAT 
ARE TENTATIVELY SELECTED TO BE USED NEXT YEAR. EACH TYPE OF 
DATA SHOULD BE ASSOCIATED WITH A DECISION-MAKER(S) (THIS LIST 
SHOULD INCLUDE CORRESPONDING DECISION-MAKERS) . A SET OF TEACHER 
OR STAFF ACTIONS SHOULD BE INCLUDED ON THIS LIST FOR EACH TYPE 
OF DATA. NO RESULTS SHOULD BE INCLUDED IN A REPORT UNLESS 
POTENTIAL TEACHER-STAFF ACTIONS ARE FIRST IDENTIFIED. NO COMPUTER 
PRINTOUTS SHOULD BE GIVEN TO TEACHERS OR STAFF (WITH THE EXCEPTION 



OF THE ASSISTANT DIRECTOR OR RA) UNLESS IT IS SPECIFICALLY 
DESIGNED FOR THEM OR THEY REQUEST IT. IN ADDITION, DATA 
SHOULD ALWAYS MEASURE AN ON-GOING PROCESS AND NOT A HOPEFUL 
BY-PRODUCT . 

If there is a dispute over using the results of a particular instrument 
(such as the MAT), this process may help resolve the issue. It is jointly 
the responsibility of the assistant director (or RA) and the decision-maker 
to go through this process before next year's testing begins. This also 
might help eliminate a re-occurring problem vdiich is , that if no positive 
results are attained, the decision-maker often concludes that the instrument 
was not appropriate . More than likely, however, the decision-maker does not 
know what action to take based on non-positive data or that no part of the 
program is specifically designed to develop \diat is measured. 

While this kind of problem does exist, the evaluation system — as 
designed by the director, by EES, and by the RA — certainly does encourage 
the articulation between subprograms and helps break down the divisions which 
have traditionally existed between the various groups operating within a' 
school. The Follow Through director promoted a high degree of coordination 
between the various groups operating within Follow Through. The EES sponsored 
feedback sessions were also very valuable in unifying the system. 

Did the Teachers Perceive the Feedback as Being 
Beneficial and Was There Evidence They Used It? 

It is important to have’ a system of evaluation that operates, in part, 
at the classroom level and that involves the direct participation of the 
teachers. To keep up with the progress of children and give appropriate 
direction, teachers and staff not only must know vdiat action to take, but 
must receive the information they need when they need it. When asked, via 
an anonymous questionnaire, how they perceived the feedback system, 38 out 
of 45 teachers responded to the questions as follows: 
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Did the research feedback (EES reports, child profiles, data) you received 
this year help you understand your children better or improve your teaching? 

/lO/ Very much / 14 / A little /To7 Not really Don’t Imow 



Was the feedback you received immediate enough? 

/ll/ Yes / 16 / A little late / 6 / Too late to be meaningful 

Check the service (s) that helped you identify or resolve individual pupil 
difficulties? 

/24/ Health /l?/ Social /19/ Psychological / 18 / Parent Workers 
/ 14 / Reading / 17 / Speech /24/ Classroom Aides Evaluation Feedback 

About a fourth of the teachers felt the feedback they received was useful, 
\diile the others expressed the view that not enough of the data was meaningful 
(see Appendix, page A— 2) • The evidence suggested that teachers need much 
more individual help in data interpretation, but more importantly that all. 
feedback be purposely oriented. 



Wliat Kinds of Statistical Feedback Were Needed by Teachers? 

This is a list of the measures or types of data fully or partially 
utilized by Follow Through: 



1. Color-Shape Inventory 

2. Behavioral Maturity Scale (BMS) 

3* Metropolitan Readiness Test (MRT) Pretest-Posttest 
Metropolitan Achievement Test (MAT) Pretest-Posttest 
Reading Criterion Test (RCT) Pretest-Posttest 
A criterion math test 
A criterion matrix test 
8. Bentley— Ye at t s Self-Concept Appraisal 
9» Stanford Research Institute Child Research Battery 
10. CIP (Atlanta specific) diagnostic tests 



4. 

5. 

6 . 

7. 



Teachers were very concerned about whether these measures told the whole 
story. Listed below are the responses of the teachers to \two questions 
relating to measuring child growth. 



h'i- 
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Question: List the tests or measures that you feel did or could have helped 

improve your teaching? 



Responses (Sununarized) : 

/37 Math MRT-MAT 

RCT /I 7 Tests 

BMS 



I 2 J CIP Zl7 ITPA 

Matrix Color-bhape 

/25/ No Response 



Question: What improvements should be made to help test or assess Follow 

Through children next year? 

Responses (Svunmarized) : 

_ Test skills relating to Follow Through curriculum, guidelines, 
^ and behavioral objectives . 

Too many tests or too much time spent on testing* 

Earlier testing notification. 

M/ No response* 



What Kinds of Feedback Were Needed by Administrators? 

Administrators asked for consistency in reporting longitudinal data over 
a period of years. The only measure for which longitudinal data was reported 
is the MAT (and that was rather loosely presented). In addition, was it not 
possible to supply teachers with a longitudinal profile on each child at the 
beginning of the 1970“71 school year? 

Since the program has now been in four grades it should be strongly 
requested that SRI longitudinal data be made available very soon. This data 
would be extremely valuable since initial results on the SRI Battery indicate 
that the comparison children that have been selected are very similar to 
Follow Through children in the beginning or the kindergarten year. 



MANAGEMENT-CONTROL, PROCESS, DIAGNOSIS, AND COMMUNICATION 



Who Determined the Goals and Objectives? 

Educators have always been notorious for their ability to state expectations 
in a form so vague that they become mere statements of hope or intent rather 
than objectives whose achievement can be ascertained. Follow Through's biggest 
problem, in the RA's opinion, is a lack of agreed upon performance objectives 
and expectation levels. While Follow Through has an abundant number, of process 
or enabling objectives (in various reports and proposals), it is more important 
to have specific performance objectives tied to particular Follow Through 
processes. Administrators need these objectives to judge the success or 
failure of the components of the Follow Through program. Broad indicators 
of pupil progress' (MAT, BMS, self-concept appraisal) have been incorporated 
into the evaluation effort along with a criterion test, however, few (if any) 
are currently tied to stated performance objectives. 

Two work sessions were held during the year to revise the goals and 
objectives in relation to the needs and characteristics of Follow Through 
children. The first meeting (a November retreat) focused on broad statements 
of vdiat Follow Through children should be like. This meeting was attended by 
a few central staff members (Miss Frances Cox, Directory Mrs. Ora j^derson. 

Program Assistant^ Mrs. Susan Jones, Lead Teacherj Dr. Willard V/. Crouthamel^ 
Research Assistant) and a model consultant (Mr. Don Wolff, Pro ject Co-Director) . 

A list of these broadly stated objectives is found in Appendix, page A-3. A second 
meeting (a discussion lead by Dr. Jarvis Barnes, Assistant Superintendent for 
Research and Development) was held with the central staff in May to focus on 
the objectives of the program, to determine levels of expectations, and to 
determine a priority of objectives (see Appendix, page A-4) . 

The following outline for evaluation was developed at this meeting. It is 
categorized by pupil, teacher, parental, and institutional expectations and 
contains identified indicators of change in an order of priorities selected by 



I. Indicators of Pupil Development 

A. Academic 

1. Reading achievement (comprehension, phonics) 

2. Independence (control of own learning) 

3 . Problem-solving abilities 

4* Communication skills (language, verbal, written, listening) 

5 . Mathematics skills 

6. Interdependence 

7 . Color-shape knowledge 

B. Health 

1. General achievement 

2. Prevention 

3 . Parental involvement (awareness, participation, attitude) 

4 • Attitude 

5 . Attendance 

II. Indicators of Teacher Development 

1. Classroom management (class environment, interaction patterns) 

2. Views on worth and needs of the children (expectations) 

3* Awareness of the strategies, contents, concepts, and materials 

4 . Acceptance of parents and supportive staff 
5* Enjoyment 

6. Team organization 

7 . Security in position 

8. Willingness to experiment 

III. Indicators of Parental Output 

1. Understanding of program 

2. Frequency and type of participation 

3 . Adult education and career development 
4* Roles able to fulfill 






\ 
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IV. Indicators of Institutional Change 



1 . Career development . 

2. EInthusiasm of teachers 



While these meetings were extremely useful in identifying or affirming 
types of evaluation, it is extremely important that teachers be asked to help 
develop more specific performance-oriented objectives. Only when teachers 
at the grass-roots level help develop the objectives will they feel comfortable 
with them. 

In addition, it is highly recommended that expectation levels (bench marks) 
be projected for student growth in lY 1971-72. Comparison data and baseline data 
are good for setting expectation levels. It is also recommended that individual 
school environments be carefully examined since this variable may, in certain 
instances, be more or influential than the Follow Through treatment. 

How Were the Data Reported? 

One of the functions of the evaluator was to provide useful information 
relative to the major questions raised at critical points in the development 

i 

of the program* An important aspect in doing this was the publishing or 
presenting evaluative findings in a way that results quarterly in EES oral and 
written reports and in progress reports by the RA. All remarks in these 
reports were aimed at program improvement. 



RECOMMENDATION: A SCHEDULE SHOULD BE DRAWN UP FOR COLLECTING 

AND DISSEMINATING INFORMATION TO TEACHERS. LEAD TEACHERS OFTEN 
FELT INCAPABLE OF INTERPRETING THE FEEDBACK DATA TO TEACHERS 
(SEE PAGE 31 FOR THE RESULTS OF A LEAD TEACHER QUESTIONNAIRE). 

RECOMMENDATION: EES SHOULD ALSO SEND THE DIRECTOR, ASSISTANT 

DIRECTOR,. AND RA A ROUGH DRAFT OF EACH FEEDBACK REPORT AT 
LEAST A WEEK PRIOR TO REPORTING TO THE WHOLE STAFF. IN 
ADDITION, STAFF MEMBERS, ADMINISTRATORS, CONSULTANTS, AND 
RESEARCHERS SHOULD HELP , DECIDE THE TOPICS FOR THE REPORTS. 
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What Was the Responsibility of the RA? 



The basic responsibility of the RA, as viewed by the research department, 
was to monitor and evaluate the Follow Through Program as independently viewed. 
Follow Through was monitored this year by the RA in terms of management- 
control, process, lines of communication, diagnostic procedures, and cost- 
effectiveness. The RA attempted to determine if the stated Follow Through 
purposes and objectives were achieved. 

The RA often became involved in the activities of the feedback system 
via test administration and coordination and through interaction with Follow 
Through personnel; however, the RA generally tried to be free of the 
administrative decision-making process and of the administrative control of 
the program. Unfortunately this was a difficult path to pursue since some 
Follow Through personnel perceived the evaluator as an integral part of the 
program \diose major responsibility was coordinating all feedback activities 
under the supervision of the Follow Through director. 

Several Follow Through administrators and consultants thought that the 
RA should be primarily concerned with helping teachers (that is, feeding 
back information and helping them develop behavioral objectives) . Because 
of the massiveness of the assessment effort, a new position (Assistant' 
Director'') has been created for FY 19 71-72 to perform these internal duties 
and to emphasise helping teachers use the data. It is important that the 
Assistant Director must have access to adequate funds before priorities and 
a plan of attack can be determined. The number and types of studies 
conducted depend on the organisational needs and the resources deyoted to 
providing data for decision making. Hence, with the operational activities 
being cared for by the Director or Assistant Director, the Research Assistant 
\<dll have the necessary time in which to evaluate the manner the objectives 
are being pursued, to identify deviations from the objectives, to identify 
promising practices , and to determine the cost-effecUveness of the program. 



-5S- The name has recently been changed to Coordinator for assessment* 



These functions are separate from those of routine data gathering needed to 
carry on the daily tasks of the program. These latter functions are operational 
and should be performed by someone other than the RA vdio is concerned chiefly 
with development, evaluation, and dissemination. 



Do Follow TLrough arid the School Program Merge, Is Follow Through 
Only a Resource , or Is It a Separate Group of A ctivities? 

Teachers have mixed feelings about the question, "Is the project operated 
in isolation as opposed to being operated as part of the total school program"? 
Presented now are the teacher's anonymous responses to related questions; 

Which best describes your attitude about Follow Through? (See Appendix B for 
breakdown by grade.) 

Extra resources . and A way of improving Extra 

^ training for me the whole program at requirements 

my school "to perform 



Do you feel the Follow Through project is isolated from the rest of the school? 



FT staff tends to /137 To an extent 

/6/ operate apart from 
the regular school 



Probably not 




No, FT encourages 
communication 
among: all school 
personnel 



Was the principal able to help you with anything related to Follow Through? 



Principal was big help 
/tZ but not specifically with 
FT activities 



Did not perceive 
principal as part 
of FT program 



Principal contributed 
/t 7 in many FT activities 
which benefited me 




Principal did 
not help directly 



Are there too many Follow Through' requirements that are disruptive to your 
normal teaching rc;::*:ine? 



Yes • /T^ At certain times 



/ll/ No, they usually help 



Were you able to- develop yoiu*: own classroom, objectives because of Follow 
Through support and encouragement? 

/iS/ Yes /iibZ To some extent No . 



i 



Do Follow Through processes complement or duplicate the regular school program? 

Little coordination Duplication & 

^ between them ^ 



Complement & supplement 
each other 



conflict 



Have you received information or ideas on other early childhood programs 
because of Follow Through? 

y — 7 Present other approaches /ll/ Occasionally Very Seldom 

^ Yes, FT personnel 

Did Teachers and Administrators Participate in the Bhraluative Planning? 

All central staff members were involved extensively in planning for the 
evaluation. Principals and area superintendents were invited to feedback 
sessions, but otherwise were not really encouraged to participate in the 
basic evaluative planning sessions. Lead teachers have helped and given much 
support in formulating evaluative plans and in implementing them. Teachers 
often expressed their views on testing, but were seldom called upon to aid in 
this planning. 



RECOMMENDATION: A FEW TEACHERS SHOULD PARTICIPATE IN THE 

DECISIOK-MAnNG AND PLANNING PROCESSES. DIFFERENT TEACHERS 
COULD BE IDENTIFIED EACH TIME. THIS WOULD NOT ONLY PROVIDE 
A GRASS-ROOTS PERSPECTIVE, BUT GIVE TEACHERS A FEELING THAT 
THEIR SUGGESTIONS ARE BEING CONSIDERED. 



Did the Feedback Generate Supplementary Evaluations? 

There have been a host of supplementary evaluations generated this year. 

The following list is some of the questions that were asked of EES: 

1. What is the relationship between the MAT (reading comprehension 
subscore) and the RCT? 

2. What is the relationship between the MAT and Cl P results? 

3» What is the relationship between attendance data and the MAT 
reading scores? •. - 

4* What is the relationship between the self-concept scores and 
academic achievement? 



Most of the questions remained unanswered, however. 
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To What Extent Did Area Superintendents and Principals Administer Follow 
Through in Their Areas and Schools? 

Several principals and lead teachers commented that there needs to be a 
greater decentralization of the administrative process with more classroom 
oriented decisions being made at the school administrative level. Systematic 
and more regular means for involving principals in all phases of planning and 
coordination should be considered. Principals need to be kept continuously 
informed of all aspects and encouraged to play a significant role in the 
total program. If this does not happen Follow Through will fail to make a 
substantial impact on the school system. Principals and area superintendents 
are important links to spreading a program. Inviting principals to a few 
meetings is not enough. 

From discussions with principals and area superintendents it was evident 
they are eager to participate more fully. Their extremely limited Follow 
Through role has probably caused teachers to respond negatively to the 
following questions: 

Was the principal able to help you with anything related to Follow Through? 



[j! but not specifically with 
FT activities 



Principal was big help 




Did not perceive 
principal as part 
of FT program 



Principal contributed 




Principal did 



IjJ in many FT activities 
which benefited me 



Summary of how principals helped: 

Provided materials and resource personnel 

Provided constant support and guidance in planned activities 
/l7 Helped organize parent activities 




Were your school administrators (^eluding principal and head lead teacher) 
enthusiastic about Follow Through? ' , v • 



/T^ Yes ' /137 Moderately ■ • /t7 No 



\ 
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what Were the Chaimels of Conanunicatibn Between .the Schools and the Central 
Follov Through Staff (not including staff assigned to schools)? 

The lines of communication and patterns of interaction between the central 
staff and lead teachers were excellent and provided for very substantial 
dialogue. Follow Through personnel received much cooperation from the school 
staffs. The interaction between the central staff and teachers was moderately 
effective with the coordinators doing much of the interacting with the teachers. 

To the question, "What Did the Follow Through Central Administrative Staff 
Contribute That Was Directly Beneficial to You?" the teachers responded as' . 
follows: 

/JJ New educational games and resources 

flj Materials and supplies 

flj Testing assistance and feedback 

Beneficial workshops and conferences 

fdj General assistance and leadership ' ' • ’ 

!XJ Nothing directly 

/W No response ' , ■ 

Were Follow Through Objectives Meaningful to Teachers? 

The teadhers responsed to questions about the meaningfulness of objectives 
as follows: • , • 

Were the objectives of Follow Through meaningful enough for you? 

/247 Yes /ll7 Need to be clarified . No, very vague 

Were you able to develop your own classroom objectives because ofvFollow"' 
Through support and encouragement? ‘ 

/l8/ Yes /l6/ To some extent . 7^ No' . * 



RECOMMENDATION: SEVERAL TEACHERS SUGGESTED THAT OBJECTIVES ' 

BE MADE MORE MEANINGFUL BY MAKING THEM , MORE PERFORMANCE ' ‘ < 
ORIEOTED. TASK FORCES OF TEACHERS COULD HaP Wra ^ 

behavioral OB JECTiEVES DUfeOTC Tfffi SUM^ vfe OBjECTiVE^ ^ v 

THAT ARE BOTH INDIVIDUALIZED TO MEET Tfffi Abs OF^^^P^ 

CLASSROOMS OR THAT ARE GENERALIZABLE TO 
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Were Role Expectations Being Fulfilled? 

When asked about role fulfillment teachers responded: 

Was the lead teacher able to contribute. to your teaching effectiveness by 
observation and advice? 

j-L Observed class often Helped when she could Not really 

& gave good advice 

What/were your views on the presentation of new materials and ideas by yoiu* 
lead teacher? 



Superior presentation 



Presentation 
generated enthusiasm effective 



Was your aide effective instructionally? 

/23/ Usually Occasionally 



Presentation 
^ inadequate 



/37 Seldom 



Check the services that helped you identify, or resolve individual pupil 
difficulties? - ' 

/^7 Health M] Social /l^ Psychological /W Parent Workers 

/147 Reading /T^ Speech /247 Classroom Aides Evaluation Feedback 

Check the group(s) that helped you become more attuned to parental views arid, 
feelings? 

/l^ Social Workers. PW Parent Workers /W Parent Volunteers 

/ 15 / Classroom Aides fsl None of these 

The results, in addition to school observations, indicate that the 
Follow Through personnel assigned to schools in supportive roles were living 
up to expectations quite well. Better attitudes and better planning were 
fostered by the team approach. The role of lead teacherj however, should be 
thoroughly reviewed with an emphasis on demonstrating more and telling less. 

Data also indicated that the feedback system needed more attention as to 
vdiat data should be disseminated to teachers and how they could use the data. 

It did little good to give teachers data merely because the data were available. 

Were Comprehensive Curriciilum Guides Available for the Teachers to Follow? 

We need more specific c^riqi^um^^,^ 

where it is we are expected to lead our ch^dren, rather than vague, general 



me 
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objectives \rfiich tell nothingv . \ 

Teachers generally agree via the questionnaire. 

Are you satisfied with Follow Through curriculum guidelines? j 

A 3/ Yes /im partially ^ No j 

Summarization of vdiy they replied to this question. / 

Need more specific objectives & 
skills (clarified) 

^7 Piecemeal approach 

/T-7 Incomplete, no tentative curricu- 
^ lum 

Too much 

plj Does not stimulate achievement 



/m Very worthwhile & well defined 
/77 Includes important reasoning skills 
plj Stimulates teacher creativity 
/77 Not enough math, science 
/T7 Enacted communication incomplete 



Was the curriculum organized such that you knew what skills and materials were 
appropriate for each child? , 

. . , . Mt Yes ■ . /8/ Some parts were .m No ... 



Which components of the curAculura (for example^ Math, Reading, Enacted 
Communication) were not effectively organized? 

/im Math 

IT! Reading 

/m Enacted Communication 



/17 All were 
w No response 



Was There an Adequate Source of Materials? Written Information? 

When asked these questions teachers responded: 

Did you receive enough written information about Follow Through? 

y^Yes [\ ^ To some extent No 

Could you get Follow you needed them? 

/13/ Almost always /20/ Sometimes late plj Almost never 



A problem which existed iJ^ Follow Through was t bhat 

certain basic adnLLnistrative tasks were actually performed. Procedures must 
be determined to, insure that teachers have all h^d out and 'materi'ais heeded 
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at the first of school year and that all consultant information filters down 
into every classroom. When the process drags out into the school year, 
teachers generally give up all attempts to get such materials (as some second 
and third grade teachers did this year). Verification should also be made to 
insure that all principals and administrators were given notification of all 
feedback meetings. 

One complete set of model literature and handouts should be given to all 
teachers at the beginning of the school year. 



Were the Opinions of Parents Incorporated Into the Program and 
What Effect Did This Have on Child Progress? 

The Follow Through program was deeply committed to the involvement of 
parents in school activities and the importance of parent's feelings about 
the progress which their children were making in school. The opinion of 
parents were incorporated in most aspects of our program through a series of 
specific activities which actively involved parent aides, parent workers, and 
PAC members. Parents should be given more opportunities to participate in an 
overall decision-making role such as they do in Career Development Committee 
meetings. Anne Hutchinson, Program Assistant; for example, encouraged parents 
to play a substantial role in the planning and management of a career develop- 
ment ladder. This certainly was in line with the direction identified at our 
negotiations session in New York and at a Follow Through evaluation conference 
in Washington. 

RECOMMENDATION: ENCOURAGE ONE OR MORE PAC MEMBERS TO AT TMD 

STAFF IffiETINGS, DISSEMINATION MEETINGS, MD MODEL CONFERENCES. 



Teachers responded to various questions on parental input as follows: 



How were you able to incorporate parental views into your instruction? - 
(Summarized) ' ^ ^ ^ ^ 



Have parents work in classroom 

Learned their views 

Attended Paren^^ (for their 

LJ yiews and conversing with them) 



fn Was not ■ 
/llj No response 



How do you feel this contributed to teaching children? 

(Summarized) 

Helped in learning about /17 

individual children (their 
behavior and home environment) 

Helped parent become attuned to / 30 / No response 

Follow Through objectives so 
that they could help 

^ Better parent-teacher support 

Do you have reason to believe that parents visited your class more often due 
to Follow Through? 

/T37 Yes Not sure /TS? No 

Did parental concern about their children seem to affect the children? 

MI Yes /147 Not sure ^ No 

Did Evaluation Foster Curriculum Improvement? 

Evaluation has made an impact on curriculum improvement in the area of 
reading (specifically the DAD program) in terms of identifying decoding 
strengths ^d weaknesses of children. Some progress also has been' made 
during the year in identifying the math and matrix skills children need 
additional help ^th. Model personnel intend to identify those skills vdiich 
are measured by the MAT that are the most relevant to the ILM Model. Further 
they will determine how the model has progressed and in vdiat direction we need 
to pursue based on an MAT item analysis currently available. The re-examining 
this year of our philosophy of evaluation is promoting a greater emphasis on 
diagnostic teaching and the setting of more performance oriented objectives. 

In addition, continuous monitoring of the program indicates that the ratio 
of development-time and effort versus implementation-time and effort may be 
unbalanced in favor of the developmental side. 

Were the Tfinks Between the Sponsor and the Sc hools Sufficient? 

It is quite amazing how well the model staff, as a whole, became attuned 
to the environments of Follow Through schools. The new model sponsors provided 



excellent leadership and should be able to accomplish the pulling together 
of the curriculum and strategies by the middle of FY 1971-72 • 

Teacher’s responses to questions about the help they received from model 
consultants are categorized as follows: 

Did Model, consultants help you manage your class more effectively? 

Provided much help in rp^ Only provided materials Merely imposed 

l ^/ managing activities and guidelines ^ requirements 

Did consultants follow-up their orientation activities with observations of 
your classroom? 

/l8/ Usually /lb/ Sometimes Seldom 



What consultants have you really received valuable help from? 

/l6/ Math (Mont, Winters) f\J None 

/28/ Reading (Richardson) /37 No response 

/l 1 / General Curriculum (Gctkin, Wolf ) 
i 14 / Enacted Communication (Shaw, Ally on) 

/s7 Classroom organization (Gravel) 



Which consultants would you like to visit your classroom more often (because 
you need more help in that area)? 

/T7 General Curriculum Assistance Science 

Math Classroom miuiagement & 

rm ' . ^ • behavior 

/lO/ Enacted Communicatxon 

r-i ■ . flj No one in particular 

/5/ Reading 

/\lj No response 



One should not try to compare consultant’s efforts to help teachers solely 
based on these data. Obviously each has different roles, modes of bontact, 
and time available. Some work with individual teachers, some' with /groups, 
and some with administrators. What the data did point put, howevei*,, is 
that the teachers had very positive feelings about the model consultants. 

While the ILM v»s not atten^pting to focus on all curriculum areas and 
objectives, the RA believes they will be able to work on these concerns during 
FY 1971-72 since their links with the schools are so strong. 



• How to pull together the curriculum model strategies 
(processes)? 

• How consultants can help teachers become managers of their own 
classrooms (as opposed to imposing requirements on a teacher 
that she has not helped determine)? 

• How the program can be monitored more intensively by keeping track 
of the dissemination and flow of model information and by observ- 
ing the grass-roots application of recommended procedures (that is, 
does information filter do\rti into the classroom, do teachers^ 

have time to consolidate things, are procedures implemented, 
and do teachers know vdiat their expectations are)? 

• How much of the program for Follow Through consultants should 
originate in Atlanta? 

What Impact (Spin-off) Did Follow Through Have on Personnel in and out of the 
Project? 

If Follow Through is to have an impact on the school system it must first 
make a significant impact internally (that is, based on enthusiasm within the 
Follow Through schools). What is expected of the children should also be 
expected of the project. That is, does Follow Through help teachers to help 
themselves rather than simply being a set of resources or requirements? ILM 
is basicallly a process model designed to help teachers help themselves and 
to stimulate institutional change . 

National and local administrators have identified three audiences vdiich 
are in the best position to influence significantly the kind of longlasting 
impact Follow Through will make, on the Atlanta School District. These three 
groups are: 

• Follow Through parents. 

• Follow Through teachers. 

• Follow Through principals and area superintendents i 

Follow Through teachers were questioned concerning how they feel about 

the program in general (techniques, administration, their own input, others). 
Here are the responses to those questions: 
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Were there any non Follow Through teachers at your school (from any grade) who 
you saw doing anything they learned from Follow Through? 

/2^ Yes ./Ts? No 



What (summarized) : 

/16/ Follow Through games ■& game format 
/l7 Enacted communication 
/l7 Classroom organization 



^7 Small group work 

j—j Other Follow Through 
^'routines 

/37 No opportunity to observe 
IE No response'^'" 



Specified types of Follow Through games by non Follow Through teachers: 

^ Math ^Matrix 

Language Lotto /T7 Concentration 

Is yoixr school administration (including principal) enthusiastic about Follow 
Through?. , , - , 

.. Z07 Yes /13/ Moderately No 

Given your past teaching experience, do you believe children are better off 
because of Follow Through ?'*^''' 

Can't really see Lack 

experience 
to make . 
comparison 



IW 



FT Children are 



FT Children 
are better equal to children 

' in. other good pro 
grams I have seen 



^ a difference be- 
- ^ tween FT Children 
& Non-FT Children 



Which best describes your attitude about Follow Through? 

Extra resources and A way of improving Extra 

training for me /l67 the vhole program requirements 

at ngr school to perform 



All Teachers ( 7 ) at Wesley Avenue, did not respond to this question. 

Teacher CorniiTents: Follow Through Children are better in Kindergarten. 
Follow Through Children are better in some y;ays and not as good m 
others, y'. r ■ .■■■ ; 
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Was the principal able to help you vd.tfi 'any4:hihg 'related to Follow Through? 

Principal was big 
p:jj help but not 



specifically with 
FT activities 

Principal contributed 

/7/ in many FT activities 
vdiich benefited me 



Did. not perceive 
principal as part 
of FT program 



___ Principal 
/lO/ did not.., 

help directly 



Do you have reason to believe that parents visited your class more often 
due to Follow Through? 

/l3/ Yes Not sure /is/ No 

Did parental concern about their children seem to affect the children? " 
/l6/ Yes - / 14 / Not sure flj No . ^ 



■ ; This information suggested that in many , of the schools the go^s of 
Follow Through are actually becoming part of the regular school program,’ but ■ 
that principals and. parents must be encouraged to play more of a role in this 

effort* V *, .. ;• r , 

The Follow Through approach (in particular the games format) was 
presented in non-Follow Through schools by Donna Baker via a ..series of very . 
informative disseminatiori sessions. This work was certainly" valuable towards 
building a foundation for long term system impact. Perhaps the real measure 
of the inqjact of our program, however, will occur next year in the 4th grades 
of Follow Through schools. If the project does not ”i:ub off” on those classes 
then there is little reason to believe, tljere will ever be a spin off that will 
effect the system as a whole. 



RECOMMENDATION: INCLUDE 4TH GRADE TEACHERS (IN FOLLOW 

THROUGH SCHOOI^) IN AS ;M^ POSSIBLE 

ON A CONTINUOUS BASIS - - NOT MERELY INSERVICE-TYPE PRESENTATION . 

RECOMMENDATION : IMPLEMENT A SPECIFIC PROGRi^^^^^T^ TEACHEKS 

SPEND MORE TIME OBSERVING OTHER TEACHERS, PARTICUIARLY 4TH 
GRADE TEACHERS. 



To What Extent Were Follow Through Children Involved in Activities and Games? 

One of the, strongest aspects of Follow Through was the games approach - 
The follo\d.ng questionnaire results focused on the games format as perceived 
by teachers: 



Do children seem to be more involved and active because of Follow Through? 

/22/ Yes, definitely /9/ Possibly /O/ No y— y Lack experience to make 

comparison 



Did your children complete most of the games they started to play? 



,-^-7 Completed 
most 



7 Completed 

tnJ 



some 



y Few completed before Roving 
^ to another game 



Do you think it’s realistic to say that the game formats help children gain- 
control of their own learning? 

Merely educational /Tt 7 There is some evidence Encourages 

^ jargon enthusiasm 

for learning 

Did children at higher levels of mastery actually help other children learn 
to play games rather than simply playing together? 

/2l/ Often /Tiy Only under constant supervision /O/ Rarely 



Do you think the game formats and strategies were appropriate? 

Most Were Some Were Few Were 

K 

2 

3 

Total, 20, 

The games approach definitely encouraged activity and involvement and 
encouraged bur children to work together (interdependence) • in particular 
there was statistical evidence that using game formats helped increase the 
academic performance of kindergarten children* We must make sure that at the 
2nd and 3rd grade levels we do not just play games in lieu of instruction* 
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Were Inservice Sessions Considered Appropriate and Effective? 

Another positive aspect of the Follow Through program was the inservice 
orientation of teachers. Teachers responded to that question in the 
following manner; 

Were Follow Through inservice sessions beneficial and informative? 

723/ Most were / 13 / Mixed feelings Not worth the time 

Consultants should continue to apply to teachers many of the strategies 
devised for teaching children such that teachers continue "taking control 
over of their own teaching". 

Did Parents, Aides ^ and Teachers Work as a Team? 

There was a healthly degree of interaction and spirit of cooperation among 
staff members. This occurred, in part, because of a beneficial overlap in 
role function resulting in staff members being involved and interested in vdiat 
other, persons were doing. 

When asked about team work teachers responded; 

Was there team work between all Follow Through personnel at your school? 

Only within the Between classrooms Little real 

^ classroom L--J most personnel ^ team work 

The Urban Corps students vdio were employed by Follow Through this year 
were in many cases, able to add enthusiasm to the classroom environments 
(these students were identified by the Research Department and served as 
classroom aides). 

What About Follow Through Teacher-Pupil Behavior and Classroom 
Interaction During Game Formats (Classroom Management)? 

A description, of teacher— pupil behavior which is appropriate during each 
game format would be useful. A complete description is needed of the child 
vdio is playing a game well. , A list; of various kinds of behavior could be 
drawn up and matched with appropriate teacher behaviors. (For example. What 
behavior is appropriate when children do not wish to complete games?). Perhaps 
a video taping could be made demonstrating how a teacher orients her class 
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to a game and how she acts to get children to begin managing the game. If 
video tapes were available, it would help bridge the demonstration gap between 
lead teacher and teacher. 



We need to loiow information such as how long children maintain attention 
and what kind of games are most appropriate for what levels. Also the rules 
which are the basis for positive reinforcement might be more specifically- 
identified. 

When asked various questions about classroom management and interaction 
teachers replied; 

Do you usually know vdiat to do if a child exhibits inappropriate behavior 
while playing a game? 

/32/ Usually /6/ Often don't 

Did children at higher levels of mastery actually help other children learn 
to play games rather than simply playing together? 

/2l/ Often /12/ Only under constant supervision /57 Rarely 



Did your children complete most of the games they started to play? 



rr^. Completed 
most 






Completed 

some 



Few completed before moving 
^ to another game 



Do you think the game formats and strategies were appropriate for your 
children? 

/20/ Most were /14/ Some were J\/ Few, were 
How Was A Child's Progress Measured When He Took Control of His Own Learning? 



Unfortunately, no one has been able to answer this question. Teachers 
did feel that there is some evidence that children are more enthusiastic 
towards learning. 



Do you think it's realistic to say that the game formats help, children gain 
control of their own learning? 



& 



Merely educational /17/ There is some evidence 



jargon 



_____ Encourages 
/I6/ enthusiasm 
for learning 



Were Follow Through Processes Properly •Integrated into the Total School ^ 
Curriculum? • . 

Follow Through complements the school program in the sense that, many 
of the goals of Follow Tlu^ough were incorporated into the regiilar . school 
program. When asked about the merging of the two, teachers responded: 

Do Follow Through processes complemerit dr duplicate the regular school program? 

Complement & supplement .-^ Little coordination : Duplication & ,, 

each other ^ between them ' conflict 

Are there too many Follow Through requirements that are disruptive to your, '• 
normal teaching routine? ’ v 

^7 Yes /T^ At' certain ■ times - /Ti7 No, they usually help 

Were you able to develop your own classroom objectives: because of Follow 
Through support and encouragement? 

■ ■ /l8/ Yes /l 5/ T 6 some extent ’ • ’ fll No ' 

What, Effect Did the Administrative Climate Have; on Follow Through? ■ > 

In an effort to assess the ehtept to v^ich personnel have had a voice 
in decision making and the extent they perceived their suggestions were 
followed, this question was asked of teachers: 



Did you have any voice in Follow Through ' decisions that were made this year? 

Able to express 
i^l ny views & they 



were adequately 
, . considef ed . : 

No, effective, way 
to express my views 



' My views were expressed 
/is/ but few we re ade quat e ly 
considered 



Satisfied, with program ' . 

/^ & did hot have to ex- 
press vie w^^^ ’ 



• In addition, the .teachers were asked about the role of the principal and 
centra adminii 
categorized below. 



the central administrative Staff. - The responses^* to relkted ques^^^ 






■■ 
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Was the principal able to help you with anything related to Follow Through? 

Principal was big Did not perceive 

/^ principal as part 
of FT program 



1^1 help but not 



Principal did not 



specifically with 
FT activities 

Principal contributed 
in in many FT activities 
which benefited me 

HoW’ did he help (summarized) : 

Provided materials and resource personnel 

/^ Provided constant support and guidance in planned activities 

f\J Helped organize parent activities 

/28/ No response 

What did the Follow Through central adjninistrative staff contribute that was 
directly beneficial to you (summarized)? ^ 

: /3/ New educational games & resources 

& supplies , ' 

- ,, , IAJ Nothing directly 

assxstance & feedback ; V-'- 

rrt , , . ^ /20/ No response 

' Beneficial workshops & conferences * — ' 

The administrative climate of Follow Through needs to become much more 
responsive to the views and opinions of all personnel - - particularly those 
of parents, teachers, and principals • 

How Did Follow Through Affect Teacher Enthusiasm? 

Teacher enthusiasm seemed to depend on what grade was taught^ thus 
Kindergarten teachers were very enthusiastic and third grade teachers were 
not. Specific results by grade are presented below: ^ “ 

Are you a more enthusiastic teacher because of Follow Through? 



General assistance & 
leadership 






K 

1 

2 

"3 
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Several teachers favored establishing periods of time for consolidation 

with no additional requirements being placed on them. This policy proved 
to be successful when iimplemented by the director last February. 

What About the National Evaluation? 

So far little information has been received from national evaluation 

efforts . Unfortunately SRI is not really set up to help communities assess 
their own objectives. We receive memo's stating that reports will be made 
available but significant information has not arrived. It appears that most 
subcontracted evaluation agencies are only interested in their own thing. 

What About National Consultants? and Administrators? 

The project, has some outstanding national consultants and administrators 
who have a real feeling for the concerns of Follow, Through in Atlanta. Dick 
Henze, our general consultant, did much to help organize the operation. 

Warren Kinsman, our consultant for the supplementary training of aides, 
identified an avenue \diich may serve as a catalyst for involving parents in 
the overall decision-making process. In addition, Don Burns, Robert Egbert, 
and Jim Turk, while visiting Atlanta, made many positive suggestions for 
improving the project. 

Was There Evidence of a Sequencing of Program S k ills and Were Teachers Able 
to Identify at What Level a Particular Child was Performing (and What Were 
the Procedures for Checking Student Progress)? 

Kindergarten teachers and many first grade . teachers felt quite secure 
using the games and processes developed by the ILM staff. Second and third 
grade teachers (plus lead teachers) sometimes expressed concern about the 
lack of achievement levels specifying which parts of the curriculum were most 
appropriate for children with specific characteristics. When asked about 
evaluating the performance of their children, the teachers felt they knew 
their children quite well despite the fact that levels of learning were not 
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identified. 




Do you feel you know your children well enough to accurately evaluate their 
skill and performance? 

Know each Know well enough Lack complete j Not really sure 

/ 27 / child quite /t 7 given the number ^7 knowledge on ^7 how well I know 

well of children many children j any of them 

! ■ 

Levels of learning, based on a sequencing of skills or processes 
(because ILM is a process model), could be developed as a guideline for 
teachers • 

Should the Role of Lead Teachers Be More Restricted So That More Time Can 
Be Spent in Training, Assisting, and Observing Classroom Teachers? 

Three lead teachers responded to an anonymous questionnaire on the role 
of the lead teacher. The responses of the three lead teachers (who will be 
labeled lead teachers A, B, and C) are listed below; 

I • • Please estimate the number of hours you spent during the year performing 
the following activities; 



Lead Teacher 




A 


B 


C 




1 

2 


3 


70 


Discussing the Follow Through curriculum with your 
principal (not head lead teacher) • 


0 


5 


70 


Discussing Follow Through Data with the principal. 


7 


4 


20 


Discussing Follow Through Data with groups of teachers. 


5 


3 


100 


Discussing Follow Through Data with individual teachers. 


5 


0 


3 


Coordinating with social agencies. 


10 


200 


100 


Diagnosing the strengths and weaknesses of individual 
pupils (working with individual pupils). 


8 


9 


25 


Consulting individually with Follow Through model 
consultants (not meetings or conferences) . 


15 


9 


10 


Consulting individually with Follow Through model 
administrative personnel (not meetings or conferences). 



II* please estimate the percentage of time you spent during the year on each 

of the follovdng activities (this list of per cents should add up to 100^) : 



Lead Teacher 



A 

25 



10 



10 



2 



15 

10 



B 

20 



10 



2 



10 



2 



C / 

i 

10 Clerical duties (Follow Through records , distribution 
of handouts or materials, obtaining materials , test 
' scoring, data collection, surveys, requisitions, and 
others) • 

8 Administrative duties (scheduling, orgainizing meetings, 
planning, coordinating, test administration, pupil 
placement, and others). 

6 Attending Follow Through meetings cuid conferences 
(planning, inservice, feedback, model-sponsored or 
administrative but not including those you scheduled 
for your teachers) • 

6 Non-Follow Through school activities (school meetings, 
committees, filling in for teacher, school 
re sponsibilitie s ) • 

10 Observing teachers and classroom activity. 



5 8 Demonstrating new ideas, materials, and methods to 

Follow Through teachers (net merely presenting teachers 
with handouts, but training or showing them individually 
or at meetings). 



5 



D 

10 

3 

2 

3 



5 4 

5 10 
10 15 

9 10 



20 10 
2 2 



Working with parents (concerning their children, school 
policy, training for them, community involvement, and 
others) . 

Development of games, materials, tests, or new ideas. 

Individual discussions with teachers (discussion of 
objectives, lesson pleUis, ideas, materials, but not 
demonstrations) * 

Discussions with Follow Through supportive personnel 
(social, parent, or health workers, psychologist, 
speech, art, music, research, administrative). 

Working individually with children (diagnosing, 
instructing, disciplining, telling stories, and others). 

Investigations or Readings (studies you design, 
professional growth, studying early childhood techniques, 
and investigation of absenteeism). 
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This table helped separate the educational activities from the management 
activities. If the results were even roughly indicative of the three other 
lead teachers then only about one-fourth of their time was actually spent in 
training, assisting, or observing classroom teachers. The aide that will be 
assigned to the lead teacher next year will help free the lead teacher from 
clerical duties. 

Empliasis should now be put on helping teachers through demonstration, 
observation, and individual assistance. Demonstrate more, tell less should 
be her motto. 

Lead teachers should not just hand out "pat programs" but work with the 
teachers recommending changes when needed and supporting existing techniques 
when effective. Teachers need feedback on how the program is progressing in 
their class. Consideration might also be given to whether lead teachers can 
adequately represent their teachers in evaluative planning. 

What About Test Administration, Test Standardisation, and Test Coordination? 

The function of a test is to discriminate among individuals with maximum 
precision and fairness. To do this there must be a continued emphasis on high 
quality data-gathering mechanisms. The following recommendations are based 
on experiences gained this year. 

RECOMMENDATIONS: 

• HIRE AND THOROUGHLY TRAIN TEST TEAMS FX)R ALL EVALUATIVE 
TESTING. VOLUNTEERS^^ AND FOLLOW THROUGH SUPPORTIVE 
PERSONNEL CAN ALSO BE USED BUT ARE HARDER TO SCHEDULE. 

TEACHERS SHOULD DEFINITELY NOT BE USED FOR EVALUATIVE 
(NOT DIAGNOSTIC) TESTING SINCE IT IS MOST DIFFICULT TO 
STANDARDIZE THEIR TEST ADMINISTRATION. 

• CONSIDER PROMOTING THE NEW BATTERY OF IOWA ACHIEVEMENT 
TESTS AS A CITYWIDE REPLACEMENT FOR THE MATS. 




Thirteen voliuitcers from the Jewish Women's Council administered the 
Math and MatrLx tests this year. 



Gf’ 






R^: 

K<? 



• EMPHASIZE QUALITY CONTROL DURING THE TESTING THROUGH 
OBSERVATION AND THE RECOMMENDATIONS OF TEACHERS. 

• USE CRITERION TESTS WHENEVER POSSIBLE. 

• BE PARTICULARLY CONSCIOUS OF METHODS FOR REDUCING MISSING 
DATA ESPECIALLY DATA FOR INDIVIDUAL PROFILES. 

• ALWAYS HAVE EVIDENCE AS TO WHAT SIZE GROUP A TEST CAN BE 
ADMINISTERED TO MOST EFFECTIVELY AND EFFICIENTLY. 

• AVOID THE TENDENCY TO HAVE FOLLOW THROUGH LOOK GOOD BY 
ENCOURAGING GUESSING OR THE ELIMINATION FROM EVALUATIVE 
FINDINGS OF SPECIAL STUDENTS WHEN THIS IS NOT DONE WITH 
COMPARISON GROUPS. 

• DETERMINE A TIMETABLE FOR TESTING BASED ON WHAT INFORMATION 
DECISION-MAKERS NEED AND WHEN THEY NEED IT. 

Does There Need To Be More Articulation Among the Various Early Childhood 
Programs? 

Articulation among school district programs is largely unaffected 
by an occasional dissemination presentation. Projects can always be linked 
together through a series of specific activities and national Follow Through 
encourages the coordination of all early childhood school programs. The 
health component of Follow Through provides an excellent example of a linkage 
between Follow Through and community resources. Teachers were asked this 
question relating to the articulation among early childhood programs: 

Have you received information or ideas on other early childhood programs 
because of Follow Through? 

Yes, FT personnel present other approaches /ll/ Occasionally 

/19/ Very seldom 

What Procedures Can Be Implemented to Increase the Involvement of the PAG 
and Can the PAG Help Determine Ways to Assess the Feelings of Parents? 

Nationally, administrators are saying projects need to collect more 
information and data about parent's attitudes towards Follow Through and about 
their participation in the program. Positive parental feelings certainly 
were a good indicator of project success this year. The development by the 
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career Development Conunittee of a proposal for supplementary training and a 
career ladder was yet another means for increasing the involvement of the PAC 
in the decision-making process. 



RECOMMENDATION; INVITE A PAC REPRESENTATIVE (OR ALTERNATING 

REPRESENTATIVES) TO ALL CENTRAL STAFF MEETINGS. IF THE 

PROGRAM IS SERIOUS ABOUT PARENTS EVENTUALLY ASSUMING THE 

RESPONSIBILITY FOR THEIR OWN CHILDREN'S EDUCATION THEN THERE 

IS REASON TO BELIEVE PARENTS SHOULD BE GRADUALLY BROUGHT 

INTO THE DECISION MAKING PROCESS. 

What Contribution Did EES Make and What Improvements Should Be Made in Our 
Information Retrieval System? 

Because of the contributions of EES nany important questions were 
considered this year. Their system certainly provided a departure point for 
continuous program improvement, but project personnel must begin to shape 
carefully the system to fit the projects needs. The need for accurate data, 
decent evaluation, and planning in terms of stated priorities is more, not 
less, critical in a time of diminishing resources. Listed below are several 
of the major contributions made by EES; 

• FRS personnel continuously interfaced with decision-makers as 
to idiat goes into the data bank. 

• Feedback sessions were informative and stimulated needed 
discussion. 

• Much information was distributed in published form so that 
everyone had equal and simultaneous access to it. 

• Feedback procediures fostered curriculum improvement and 
individualized instruction. 

• Evaluation focussed on accountability and vdiether the Follow 
Through plan was actually being implemented. 

• EES personnel pushed for the statement of behavioral objectives 
and data relating to objectives. 






An analysis of complex programs being funded makes patient loiigitudinal 
study essential* Many programs are evaluated yearly^ but each time this one 
year effort is essentially unrelated to preceding years . So that Atlanta 
Follow Through might consolidate its systems approach toward longitudinal 
evaluation and so that information flow is not merely a convenient label for 
a mass of ill-defined activities here are several considerations vdiich can 
be concentrated upon in FT 1971-72. 

• More reliance on publications rather than mass printouts (that is 

condensations to make the great bulk of data more meaningful) . ^ 

• More discussions to determine the value each piece of data has 
to decision-makers and teachers (too often reports are filled 
with information little of which has much bearing on the problem 
at hand) • 

• A detailed plan for reporting longitudinal data. 

More of an effort to be thorough rather than crash efforts to 
meet specific deadlines. 

Less reliance on vdiat is available and more on specific questions 
of relevance * 

'* 

• Labeled printouts^ a reduction in missing data^ clearer formats^ 

! and verifyied data (Reports this year have contained too many 

errors) * 

• More documentation on definitions, measures, standardization, and 
on what is in our data bank. 

More conferences to determine the contents of reports, tone of 
feedback reports, and ways of verifying data. 

A detailed plan to offer the teacher technical aid and to work 
on a climate receptive to using evaluative data* 

RECOMMENDATION: A PROCEDURE TO VERIFY ALL FEEDBACK RESULTS SHOULD 

BE IDENTIFIED. 
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RECOMMENDATION; COMPLETE THE FOLLOWING ANALYSIS WHICH WERE IDENTIFIED 
AND REQUESTED THIS YEAR BUT HAVE NOT BEEN COMPLETED: 

• CORRELATIONS BETWEEN MAT (READING COMPREHENSION SUBSCORE) 

AND THE RCT, CIP, COLOR-SHAPE, AND ATTENDANCE MEASURES. 

• LONGITUDINAL COMPARISONS (RCT, MRT, MAT) 

• MAT PRE-POST ANALYSIS OF GAIN SCORES 

• SELF CONCEPT COMPARISONS (FOLLOW THROUGH VS COMPAiaSON) 



INFORMATION DATA 

Rather than reproducing any of the analyses from EES Feedback reports the 
major emphasis of this section will be to pull together EES analyses by 
looking at longitudinal information and by., filling in any gaps that exist in 
terms of relevent evaluation information. 

How Were Comparison Groups Used to Help Evaluate Follow Through? 

Comparison groups were identified to help us separate social progress 
from program progress (here we define social progress loosely to mean that 
progress \diich could normally be expected to occur in a typical low income- 
classified school). Since so many potential comparison- type schools also 
operate under special programs (Title I, Model Cities, and others) it is 
often difficult to say what a typical low-income school really looks like. 
Consequently, it should not be concluded that a lack of progress exists if 
there are no differences between Follow Through and comparison results. 
Comparison groups, viiich cut across many special projects in the typical 
low-income school, do help serve as a yardstick to measure social progress. 

A more important kind of comparison of progress, however, results from a 
program's longitudinal change compared to its own baseline data. 

Craddock, Slaton, Harris, and Slater were identified as comparison 
schools^^ based on these criteria: 

• Title I Eligibility (percentage of children eligible). 

• Location proximity to Follow Through schools. 

• Racial percentages . 

• Mobility percentages . 

• Per Cent participation in free lunch program* 

Non— Follow Children at Follow Through schools were also used for comparisons 
vrtien available. This later type of group is specifically identified when 



^ See Appendix, page A-5 for the distribution of comparison classes* 
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used since the group may not be completely representative of the Follow 
Through population. SRI pretest data indicates that Follow Through and 
comparison Kindergarten children have scored very similarily on the SRI 
comprehensive battery of basic skills (see page 40 ) • 

What About Attendance Patterns? 

Percentage 
Attendance by Grade 

K 1 2 



1969-70 70-71 


69-70 


70-71 


69-70 


70-71 


F.T. 87.8 86.3 


88.6 


88.9 


91*1 


89.8 


Non F.T. 83. 5: 83.0 


89.6 


88.0 


90.3 


90.5 


3 

69-70 


70-71 


T 

69-70 


70-71 




F.T. 


- 


88.6 


- 




Non F.T. 91*3 


91.4 


88.8 


— 











Percentage 














Attendance by School 












1969-70 


70-71 


69-70 


70-71 


69-70 


70-71 


69-70 


70-71 


English Prim. 


89.5 


87.7 


88.8 


88.6 


92.3 


90.4 ■ 






English Main 


84.5* 


83.7^ 


89.1^ 


89.3* 


90.0^ 


S9.S* 


91.5* 


90.3 


Grant Pk. Prim. 


86.4 


85.7 


88.4 


85.3 


89.2 


88.7 




89.0 


Grant Pk. Elem. 


844"^ : 


84.9'' 


89.1* 


84.7* 


90.0* 


89.2* 


86.9:* 


88.S* 


John Hope. 


87.6 


88.5 


89.0^ 


89.9 


914* 


91.3* 


92.3^ 


92.4* 


Dean Rusk 


87.8 


86.1 


90.2^ 


90.1 


91.5^ 


90.2* 


93.1* 


91.3* 


Wesley Ave. 


87.3 


86.4 


93.0^ 


89.6 


914* 


89.6* 


92.7^ 


91.9^ 


Craddock 


84.9^ 


84.9* 


92.6* 


89.9* 


93.1^ 


90.6^ 


96.3* 


96.1* 


Harris 


87.2* 


85.7* 


88.9^ 


90.9^ 


93.6* 


91.0* 


914* 


95.2* 


Slaton 


78.4* 


774* 


84.1* 


85.6^ 


83.5* 


89.2* 


86.8^ 


87.6* 



^ Indicates Non-Follow Through Class 
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How Do Class Sizes Differ? 





X No. of Classes / class 


Size by. Grade (1970-71) ' 




17-20 21-24 


■ 25-28 29-32 






Students Students 


Students Students 






K 


0 11 


4 ‘ • 0 






1 


0 5 


10 2 






2 


0 5 


0 0 






3 


2 0 


0 6 


• 


What Were 


1 ' 

Children Like in the Beginning of the Program (and After 1 Year) 






SRI Battery (pretest 1970-71) 








(Per Cent Correct) 








Wide Range 


Ach. Tests 








Verbal 


Quantitative 








(58 Items) 


(24 Items) 






Pre F.T. 


21.3 


32.5 






Kindergarten 








Pre N.F.T. 


23.4 


33*9 






Kindergarten 










Other Batteries 






Verbal 


Verbal 


Quantitative 


Quantitative 




Test 1 


Test 2 


Test 1 


Test 2 




(l8 Items) 


(26 Items) 


(9 Items) 


(9 Items) 


Pre F.T* 


56.5 


30.3 


21.4 


34.3 


Kindergarten 
Pre N.F.T. 55*3 


34.1 


26.0 


37*3 



Kindergarten 
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Color — Shape Inventory (Per Cent Correct) 
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October 70 



Follow Through Children !mow their basic colors and shapes quite well 
and do reasonably ivell on the MRT after one year in the program* 

What About Longitudinal Results Based on the HAT (First through Third Grades)? 

(Figures were based on EES reports or calculations by Research and 
Development Personnel.) 

One of the biggest disadvantages of longitudinal studies results from 
pupil mobility (approximately 305^). Due to this reason the reported results 
were based on the total pretest and total posttest population and not the 
stable (non-mobile) population* 

MAT I (Grade Equivalents) 

First Grade - Posttest Analysis 







WK 


WD 


Read 


Math 


69-70 


F.T. (Post) ■ 


1.6 


1.5 


1.5 


1.5 


70-71 


F.T. (Post) 


1.5 


1.5 


1.5 


1.6 




N.F.T. (Post) 


1.4 


1.4 


1.3 


1.4 



MAT I (Grade Equivalents) 

Second Grade - pretest-Posttest Analysis 



69-70 


F.T. (Pre) 


WK 

1.5 


WD 

1.4 


Read Math 

1.5 1.3 




(Post) 


1.9 


1.9 


2.0 1.8 


70-71 


F.T. (Pre) 


1.5 


1.4 


1*4 1.4 




(Post) 


2.1 


2.0 


1*5 2.2 


70-71 


N.F.T. (Pre) 1 


.5(1.71 


11.3(1.5)1.5(1. 7^1.4(1.61' 




(Post) 


1.6 


1.7 


1*7 1.6 



The figures in parentheses are the results of English Avenue and Grant 
Park second graders not previously enrolled in Follow Through* The 
other figure is the regular comparison group. 
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MAT II (Grade Equivalents) 





Third 


Grade (Pretest-Posttest) 


















Math 


Math 


Prob, 




WK 


WA 


Read 


Spell 


Comp. 


Concept 


Solve . 


70-71 F.T. (Pre) 


1.8 


1.7 


1.8 


1*7 


1.7 


1.8 


2.0 


(Post) 


2.5 


2.3 


2.5 


3.0 


2.5 


2.5 


2.8 


N.F.T. (Pre) 


1.9(2.0)^l 


. 9 ( 1 .S)*! 


.8(l.9)*2.1(2.0)^l 


•9(1*9)^1 *9(1 *9)^2. 1(2.0)^ 


(Post) 


2.4 


2.3 


2.3 


2.6 


2*6 


2.5 


2.6 



Indications are, that while Follow Through children seem to be v^ll 
prepared for first grade, the cumulative deficit typified by economically 
disadvantaged children begins to take its toll during the first and second 
grades. Thus at the end of the third grade there appears to be no difference 
between Follow Through and comparison children on the MAT* 



The figure in pai’entheses are results of E^iglish Avenue third graders 
not previously enrolled in Follow Through. 





What Kinds of Changes Occuirrcd Based on Criterion Tests? 



Reading Criterion Test (RCT) 

FY 1970-71 — Pretest-Posttest Results 
(Per Cent Mean Items Correct) 



Grades (Pretest-Posttest Results) 





K 


1 


2 










Post 


Post 


Pre 


Post 


Pre 


Post 


Part I Single Letter Sounds 














m 


U 


91 


90 


93 


87 


93 


P 


63 


84 


85 


98 


87 


98 


f 


38 


72 


75 


93 


83 


95 


c 


4 


33 


75 


73 


77 


77 


t 


22 


71 


74 


95 


82 


97 


* 

1 


10 


34 


58 


83 


66 


85 


m 


18 


56 


61 


84 


75 


94 


J 


13 


55 


6l 


84 


75 


92 


u 


4 


28 


34 


72 


57 


74 


Part II 














sit 


60 


69 


82 


94 


88 


97 


fan 


27 


65 


74 


93 


79 


96 


hit 


19 


48 


55 


89 


73 


S3 


nap 


5 


27 


41 


76 


60 


32 


tin 


6 


40 


48 


82 


66 


84 


tig 


4 


23 


23 


69 


50 


73 


warn 


3 


24 


29 


74 


52 


76 


fog 


1 


16 


18 


68 


43 


65 


weg 


0 


13. 


16 


52 


40 


61 


Part III Programmed Auditory Blends 














m-an 


65 


79 


73 


97 


77 


99 


p-it 


33 


6/ 


66 


96 


74 


94 


f-at 


36 


66 


62 


94 


72 


96 


b-it 


30 


55 


61 


90 


65 


91 


n-it 


19 


44 


46 


83 


58 


82 


h-id 


17 


42 


46 


85 


56 


81 


1-im 


15 


39 


33 


73 


50 


77 




^ 44 - 


48 
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Grades (Pretest-Posttcst Results) 





K 

Post 


1 

Post 


2 

Pre 


Post 


4 

Pre 


Part IV Not Programmed Trigraas 


san 


16 


45 


49 


85 


61 


ban 


14 


41 


45 


88 


59 


mip 


6 


28 


41 


70 


56 


fap 


6 


29 


30 


80 


47 


pip 


5 


27 


30 


77 


46 


bin 


3 


27 


26 


33 


45 


dog 


2 


18 


IS 


70 


36 


vig 


2 


19 


17 


69 


36 


sot 


1 


IS 


14 


56 


35 


fet 


1 


14 


13 


47 


27 


Part V Not Prograaned 
Auditory Blends 


s<>an 


27 


60 


49 


91 


59 


r-it 


32 


52 


42 


35 


52 


t-at 


27 


55 


47 


92 


56 


h-ip 


22 


51 


45 


88 


51 


n-at 


21 


46 


39 


83 


48 


b-in 


18 


46 


42 


94 


48 


p-id 


14 


41 


40 


80 


45 


j-ad 


15 


43 


37 


83 


43 


2<^P 


14 


38 


30 


74 


41 



Part VI ProgranBied Silent 
E Endings 



cape 


1 


4 


14 


41 


25 


site 


1 


3 


14 


32 


25 


dope 


0 


8 


14 


43 


26 


2 one 


0 


7 


5 


46 


16 


tabe 


1 


4 


2 


34 


10 


fire 


0 


3 


3 


35 


10 


tube 


2 


2 




26 


8 


Part VII Not pre^ramned Silent 
E ^dings 

bame 


1 


5 


10 


47 


19 


sipe 


1 


3 


9 


35 


15 


mote 


1 


6 


10 


42 


2C 


detc 


0 


2 


2 


31 


8 
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Post 



89 

89 

79 
83 
77 

80 

69 

70 
62 
57 



90 

87 

88 
88 
86 
82 
97 
83 
77 



47 

37 

51 

52 
42 
39 
28 



49 

32 

48 

28 



RCT Longitudinal Results (By Grade) 
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s- Does not include second try or blend in FY 1970-71 

;• Not part of program in FY 1970-71* 



The RCT was specially designed to test the content and skills taught in 
the DAD program* The results are quite impressive in terras of change from 
grade to grade (that is, pretest-posttest gains, from Kindergarten to grade 3)» 
In addition, year-to-year program improvement has been made in several parts 
of the program (for example, single letters in grades Kindergarten and 3 , 
bigrams in grade 2, and trigrams in grade 3)* 



Math Criterion Results (Summarised)* 

(Per Cent Mean Items Correct) 

FT 197O-71 (February 1970) 

Items (Oral Response without visual cue) 

Grades 





■ 


K 


1 


2 


3 


I. 


Counting to 10 


91 


99 


100 


100 


II* 


Counts objects (less than 10 cats) 


93 


100 


100 


100 


III* 


Counts events in time 

(less than 10 snaps) 


68 


88 


92 


96 


IV. 


Alternate counting 
(odds - evens) 


80 


97 


97 


100 


\. 


Counting from a number to 
a namber (both under 11) 


50 


83 


83 


90 


VI* 


Counting backward 


24 


57 


81 


92 


VII. 


Addition by One 


33 


63 


71 


83 


VIII. 


Addition by Two 


12 


33 


55 


71 


IX. 


Subtraction by One 


10 


33 


48 


69 


X. 


Subtraction by Two 


3 


19 


37 


38 



The results do indicate consistent grade level progress for the small 
number of skills identified on the test. The process of Subtraction by Two, 
however, was not acquired by 62^ of the third graders* 



Based on Research and Development calculations* 
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Matrix Criterion Results (Summarised)^ 
FY 1970-71 



Selects two triangles in Matrix 

K I 2 3 



(a) 


Identifies in sentence 


10 


14 


7 


22 


(b) 


Identifies - no sentence 


50 


49 


73 


70 


Identifies missing picture - 3 circles 










(a) 


Completely describes in sentence 


20 


16 


20 


30 


(b) 


Both elements - after pointing'^" 


32 


49 


S3 


22 


(c) 


Misses completely 


22 


16 


7 


4 


Selects Rabbit on table 










(a) 


Identifies both elements - sentence 


40 


31 


S3 


4S 


(b) 


Identifies both elements - no sentence 


42 


43 


33 


48 


Identifies missing picture - Duck under Table 










(a) 


Completely describes 


17 


12 


40 


30 


(b) 


Both elements - after pointing" 


20 


37 


40 


9 


(c) 


Misses completely 


20 


18 


7 


4 


Selects Boy holding Cat 










(a) 


Identifies both elements - sentence 


42 


39 


47 


26 


(.5) 


Identifies both elements - no sentence 


37 


43 


40 


52 


Identifies missing picture - Boy looking at Bird 










(a) 


Completely describes 


7 


8 


27 


17 


(b) 


Both elements - after pointing'^''* 


40 


43 


S3 


26 


(c) 


Misses Completely 


17 


14 


14 


4 



Several possible response categories have. been removed* 

The tester pointed to the rows and columns and asked what was the common 
element in each. 



7. Selects Clown juggling 5 Balls 



(a) Identifies both elements - sentence 


K 

12 


1 

16 


2 

20 


3 

22 


(b) Identifies both elements - no sentence 


22 


12 


20 


35 


S. Identifies missing picture - Clown juggling 4 Sticks 


(a) Completely describes 


2 


6 


13 


9 


(b) Both elements after pointing 


32 


37 


47 


35 


(c) Misses completely 


22 


14 


7 


0 


9* Selects 6 Ducks 


(a) Identifies in sentence 


12 


16 


20 


22 


(b) Identifies - no sentence 


17 


22 


4C 


35 


(c) After pointing 


50 


53 


13 


26 


10. Identifies missing picture - 7 Ants 


(a) Completely describes 


2 


4 


13 


22 


(b) After pointing 


32 


33 


40 


39 


(c) Misses completely 


32 


28 


20 


9 


11. Selects pictiu*e with No truck and No bridge 


(a) Chooses and describes correctly 


32 


49 


33 


48 


(b) Chooses correctly but does not describe 


15 


14 


33 


17 


(c) Completely incorrect 


25 


24 


7 


9 


12. Identifies missing picture - man on truck 


(a) Completely describes 


12 


10 


33 


9 


(b) After pointing 


20 


20 


33 


30 


(c) Misses completely 


27 


18 


7 


0 



The tester pointed to the rows and columns and asked what was the 

common element in each. 

i 



53 

o 
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I 

I 13* Matches with correct numeral 



■H- 

1 


(a) 


e 


Tugboats 


K 

S5 


1 

94 


2 

100 


100 


i 


(b) 


s 


Flowers 


47 


32 


93 


96 


1 

y 


(c) 


6 


Boxcars 


57 


71 


100 


96 


1 


(d) 


4 


diildren 


75 


32 


100 


100 



¥ 



i Childron seemed to be making little progress in describing both elements 

I of a missing picture in a complete sentence. They did much better at verbally 

t, 

I identifying the two elements of a non-missing picture in a complete sentence, 

I but had trouble abstracting and verbalizing at the same time. The implementa- 

I tion of matrix games should be carefully monitored next year with a greater 

I emphasis on teacher accoimt ability. 



Did Teachers and Aides Have the Same Perception of the Children? 



4 



9 



Behavioral Maturity Scale 
Correlations Between Teacher and Aide (October) 





Grade K 




Grade 1 




FI* 70 nr 71 




FT 70 FT 71 


Academic .Maturity 


•47 *51 


A.M 


.61 .32 


Interpersonal Maturity 


•52 .49 


IM 


.44 *26 


Emotional Maturity 


•51 ^35 


DI 


.27 -26 




Grade 2 




Grade 3 




Fi' 70 n 71 




FV 70 FY 71 


AM 


•71 ^65 


AM 


.29 


IM 


.66 .41 


IM 


- .06 


EM 


•54 .22 


EM 


•14 



! 

j 

I 



1 
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Teachers and aides perceived their children differently at the beginning 
of this year than they did at the beginning of last year. Pcriiaps this meant 
that they worked with the children in different ways. There were extremely 
low correlations between third grade teachers and aides* 

Was Humanistic Data Incorpo rated in the Evaluation? 

Much more careful thought must be given to the assessment of the 
affective - feelings domain. In March of this year a measure of self concept 
the Bentley-Yeatts Self«Concept Appraisal , was adminisvered to a sample of 
Follow Through students. The purpose was for group assessment (that is, 
Follow Through versus comparisai, grade versus grade). The Instructional 
Objectives Exchange manual recommends that the smiling face measure (used in 
Atlanta) not be used as a diagnostic measure for individuals, and that it be 
used over a period of time in conjunction with a specific instructional 
activity designed to improve the self concept. 



Self concept Appraisal 



A complete analysis of the MI FEEL • • • HE FEEL" self concept data is 
not currently available in terms of comparing Follow Through with the control 
group. So that program personnel may have some comparative information a 
group of 6 representative iletris has been identified* The means (both Follow 
Through and comparison) for these items are presented below. The identifica- 
tion of these items is based on two factor analyses run independently by 
Bentley and EES* Out of these analyses one faetdr seems to have clearly 
emerged. It has been labeled "General Adequacy" in both cases. There are 
six items that have high loadings on general adequacy in both factor analyses. 
The results presented below are our best attempt at being representative and 
at condensing the data while not having any’ other comparison information 
available. The ‘6 item means should not be looked at separately but as a group 
representation of general adequacy (at school). 







F.T. 


Non F.T 






(H= 177 ) 


(N- 97 ) 


I. 


Eating Lunch at School Makes He Feel 


4.45 


4.36 


II. 


Doing Things I've Done Before Hakes Me Peel 


4.49 


4.76 


III. 


Arithmetic Makes Me Feel 


4.26 


4.75 


IV. 


The Teacher Makes Me Feel 


4*07 


3.93 


V. 


Books Makes Me Feel 


4*23 


4.46 


VI. 


The Principle's Office Makes Me Feel 


4-14 


4*22 



Scoring Scale; 



While the Indications are that no differences exist between Follow 
Through and comparison groups it can be inferred that both groups of children 
tend to rate themselves as generally adequate and happy. No significant 
differences among grade levels were observed by EfiS. No stable relationship 
was found to exist between achievement test scores and the self-concept scores. 



/ 





CONCLUSIONS, SUGGESTIONS, AND CONCERNS 
What Kinds of Adaptations Must Occur to Make Follow Through More Effective? 



The following recommendations were based on systematic monitoring of the 
Follow Through Program. 

• Scheduled time should be spent each week by the Follow Through director 
and other key administrative and model personnel observing classes. 

This will help them develop a more realistic knowledge of the grass- 
roots level. Even though certain clerical functions may suffer at the 
expense of this policy, it would probably be worth the directors time 
to delegate more responsibility to the coordinators and not make 
decisions for them. 

• If Follow Through truly believes in a systems approach, then all policy 
should be carefully specified before school begins in the fall. There 
was a need for more time devoted to global planning. This does not 
mean plans will not change during the year, but that all events and 
undertakings such as the development of behavioral objectives, specific 
tasks, and processes have been tentatively thought out. For example, 
certain Follow Through goals are not clearly obtainable because there 
was not sufficient control over process . Thus if some of our goals are 
to improve the self concept of children, to have children take over 
control over their own learning, and to encourage creativity, then 

the specific day-to-day processes for accomplishing these, should be 
spelled out clearly. It is not enough to say that the game formats 
promote creativity, for example. 

• The complete involvement of parents should be a major concern next year. 
The parents in our program are quite capable of aiding in the decision- 
making process provi.ded they are given all the facts. Parents know 
the children better than anyone else and are the most committed to 
their growth. The CDC, for example, offers a real possibility for 
increasing participation, involvement, and the decision-making talents 
of parents and a variety of other audiences (that is, EGA and other 
community agencies). The administration of Follow Through, in the 
RA’s opinion, has become too centralized and restricts initiative at 
the community level. 

• Teachers and principals should be active participants at all planning 
meetings and conferences. The principals meeting at the end of the 
year was very helpful, however, we must think of principals as part of 
the program and not merely persons to orient. They can do much to 
improve the Follow Through classroom environment and the overall 
administration of the program, vdien given more control over the 
allocation of resources and the delegation of authority. Consultants 
also might spend more time in discussions with principals. 
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• The orchestration of the program could be greatly improved if; 

(a) A system for disseminating memos, messages, handouts, and 
general information were developed. 

(b) Agenda are distributed prior to every meeting (only to 
provide a guideline not to rigidly structure the meeting) . 

(c) Flow charts were used to show the relationship between 
components and between activities. 

(d) The purchasing and delivery of materials and equipment were 
systematized so that all materials were avai].able at the 
beginning of the year. 

• Model oriented tests should be the basis of most assessment . In 
addition, since individual data does not always tell the whole story, 
it is extremely important to monitor the program systematically. 

Since the mere provision of certain organizational features does not 
guarantee that the activities actually take place, the activities 
should be monitored. 

• There must be much more of an emphasis on quality in the processing 
of data. Feedback reports this year contain recording and processing 
errors. These errors could be greatly reduced if student information 
was kept on tape via records rather than on punched cards. The 
quality of information feedback may have suffered this year, because 
of an overemphasis on speed in reporting, and mideremphasis in the 
communication of feedback procedures among personnel, and a failure 
to carefully verify data before publishing it. 

What Are Some Further Concerns That Have Been Identified? 

1. Are Matrix games, which seem tc develop reading readiness, appropriate 
for advanced levels of reading skills? 

2. Has a total reading program been developed or does each school reply 
on its own resources? 

3. Can appropriate levels of learning be identified for pupils with 
various characteristics? 

4. Can project personnel begin to specify what feedback outcomes lead to 
what actions? 

5. Can demonstration (video) tapes be made of model Follow Through 
classroom activities? 
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How docs late entrance in Follow Through affect student progress? 



7. What effect does pre-K experience have on performance in Follow Through? 

8. How can the ratio of developmentcil time to implementation time be 
maximized for effectiveness? 

9. What effect does the game strategy have upon disadvantaged children? 

10. What proportion of time is necessary for administrators to observe 
in classrooms to acquire an overall feeling about grass-roots 
progress? 

11. Does our K through 3 curriculum mean a K curriculum is used in the 
third grade? 

What Major Improvements have Occurred this Year in Follow Through? 

A s'jnmarized list of teacher responses to this question is presented below; 

[ 2 ] More games 
/3/ Better workshops 
/3/ Math curriculum 
/l/ Reading curriculum 
/l/ Enacted communication curriculum 
/T7 Availability of Instructional Material 
pi] More informed and better communication 
/l7 Elimination of NY trip for teachers 

TEACHER RECOMMENDATIONS: 

• Need for a PE teacher. 

• Need for parents to provide more support. 

• Need total group meeting during year. 

• Need more workshop time. 

• Need for closer communications with consultants. 

What C onclusions Can One Draw ^om This Report for Use Next Year? 

Hopefully, the report will uncover a set of questions or concerns that 
had not been considered to be that important, but will be given more serious 
consideration. The report focuses on accountability and on purpose. Questions 






Better supportive help 
(Art, Music, etc.) 

^7 More goal oriented 

rr-. First year, unable to 
^ c ompare 

fP] None 

/19/ No response 
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that were continuously raised were: What is the purpose for doing something ^ 

what priority does it have, is it worth the time arid manpower spent, and is 
it being done the way it was intended to be accomplished* 

The number of processes which are investigated next year will, to a 
large extent, be determined by the manpower and financial soui“ces available. 
Since the money allocated for testing is extremely limited, we must be 
concerned with reducing the niunber of short-run benefit evaluations to make 
more effective use of resources - - the same being true of short-run processes? 

What Focus Should Next Years Evaluation Take? 

There are elements in an educational situation which strongly influence 
the results, although they cannot be considered part of the innovative pro- 
gram. It is difficult, but important, to attempt to tease apart the effects 
of program elements, because some elements may be of very limited benefit, 
although costly. This year a partial attempt was made to focus on the effect 
that the school program had on the Follow Through climate. This effort is 
written up in 6 end-of-the-year school reports and can become a major focus 
of next year's evaluations. 

Next year's evaluation could also focus on student growth in these areas: 

• Problem Solving Skills. 

• Development of the Control of one!s own learning. 

• Task Persistance. 

• Personal qualities (enthusiasm, adaptability, valuing). 

Cost effectiveness has not really been investigated this year because we 
could not agree upon measures of effectiveness the program wished to be 
known by. The related costs of the program are varied including (1) a $750 
expenditure per child above city allocations and (2) substantial amounts of 
administrative time (for example, principals) not paid for by Follow Through. 
Next year the cost effectiveness of the program can be investigated in greater 
depth through the identification of accepted units of change and the further 
identification of Follow Through budgets and related (and often hidden) costs. 
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Follow Through Data Bank 



Purpose; Continuous and Terminal Assessment 
Organization; 

1 . Demographic Information 

Sex 
Race 

Eligibility 
Birthdate 



• Name and Address 

• Class 

• Schools 

• Year in Follow Through 



Objective - To have the capability to relate this kind of factor 
to child growth. 



2. Service Information 



* Medical - Dental Record 



Objective - To make necessary referrals. 

3 o Developmental Measures (Administered at proper times) 

• Color - Shape Inventory 

• Reading Criterion Test 

• Matrix Checklist 

• Math Checklist 

Objective - To assess the performance of students on project tasks 
(to determine strengths and weaknesses). 

To update the sequencing of skills and tasks. 

4 . Longitudinal Measures 

• MRT - MAT 

• Behavior Maturity Scale 

• Self Concept Appraisal 

Objective - To provide baseline data for indications of improvement 
in terms of years gained. To provide indications of 
how well children will do in future years and if there 
is a transfer of loiowledge to other areas. 



Feedback Breakdown by Schools 



Did the research feedback (EES reports, child profiles, data) you received this 
year help you understand your children better or improve your teaching? 



Very much 



DR 


EP 


EM 


GP 


JH 


w 


T 


2 


4 


2 


0 


1 


1 


10 




Not 


really 




DR 


EP 


EM 


GP 


JH 


w 


T 


3 


0 


2 


2 


0 


_2j 


10 



Was the feedback you received immediate enough? 



Yes 

DR EP EM GP TH W T 



3 


3 


1 


0 


1 


3 


11 



A little 



DR 


EP 


EM 


GP 


JH 


w 


T 


1 


1 


0 




A- 




A 



Don’t know 



DR 


EP 


EM 


GP 


JH 


w 


T 


0 


1 


0 


0 


0 


0 


1 



A little late 



DR EP EM GP TH W T 



3 


3 


1 


4 


3 


2 , 


l6 



Too late 



DR 


EP 


EM 


GP JH 


W 


T 


0 


0 


1 


3 


1 


1 


6 



Which best describes your attitude about Follow Through? 



Extra resources and 
training for 



A way of improving 
the whole program 
at my school 



Extra requirements 
to perform 



K 1 2 3 T 



5 


_z_ 


2 


2 


l6 



K 1 2 3 T 



8 


2 


3 


3 


l6 



K 1 2 3 T 



0 


2 


0 


,2 


A. 



j)R = Dean Rusk Eh — English Avenue Main 

EP = English Avenue Primary GP = Grant Park 

T = Total 



JH = John Hope 
W = Wesley Avenue 
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Priority of Objectives 



A meeting was held May, 1971, in which Dr. Jarvis Barnes, Assistant 
Superintendent for Research and Development, discussed with the Follow Through 
staff the objectives of the Follow Through program. More specifically the 
purposes of the meeting were: 

• To focus on those objectives the staff would like to use to 
judge the success or failure of the program (vdiat objectives 
would the program like to be known by). 

• To discuss the priorities of the objectives that were identified. 

• To see if there are objectives which have not been assessed this 
year but need to be considered in FY 1971~72. 

Dr. Jarvis Barnes then outlined his concept of the structure of 
evaluation. Schematically it can be depicted as: 

Needs =^Variables =^Process ^Goals =^Objectives ^Management = Control 

The following concerns were expressed during the meeting: 

1. Can Follow Through objectives be stated in terms of behavioral 
outcomes? 

2. Can expectancy levels be determined for each objective (in terms 
of achievement levels or rates of growth)? 

3 . Can new measures be developed to assess these performance 
objectives? 

4 . How are teachers to become involved in the determination of 
objectives? 

Dr. Jarvis Barnes hoped that these concerns could be focussed upon in 
subsequent meetings so that an appropriate evaluation direction could be 
determined for next year. This meeting helped the staff re-assess and 
solidify existing evaluation techniques and priorities. 



